Papers with cross-modal entity representation learning
Entity-level Cross-modal Learning Improves Multi-modal Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-modal machine translation aims at improving translation performance by incorporating visual information. |
| Approach: | They propose an explicit entity-level cross-modal learning approach that aims to augment the entity representation by combining a translation task and a reconstruction task. |
| Outcome: | The proposed approach achieves comparable or even better performance than state-of-the-art models. |